An MPEG-4 Facial Animation System Driven by Synthetic Speech
نویسندگان
چکیده
This paper’ provides an overview o f the act iv i t ies that have led to the development o f a prototype appl icat ion o f a “talking head” compliant with MPEG-4 spectfication. The work done so far Jits in the context of one of the recent work-i tems def ined by the ISOBEC JTCI/SC29/WGll world-wide known as MPEG. This IS0 Working Group is now in the process o f de f in ing a uni fy ing framework where natural and synthet ic audiovisual objects can be combined and rendered as a unique bouquet of synchronised interactive media. The developed facial animation system implements the following features: animation of predefined / downloaded face models , animation of face models driven ei ther by speech synthesis appl icat ions or by MPEG-4 animation parameters. To improve photo-realism, face models can be texture mapped and calibrated according to the countenances of real people.
منابع مشابه
A Low Bit-rate Web-enabled Synthetic Head with Speech-driven Facial Animation
In this paper, an approach that animates facial expressions through speech analysis is presented. An individualized 3D head model is first generated by modifying a generic head model, where a set of MPEG-4 Facial Definition Parameters (FDPs) has been pre-defined. To animate realistic facial expressions of the 3D head model, key frames of facial expressions are calculated from motion-captured da...
متن کاملText2Video: Text-Driven Facial Animation using MPEG-4
We present a complete system for the automatic creation of talking head video sequences from text messages. Our system converts the text into MPEG-4 Facial Animation Parameters and synthetic voice. A user selected 3D character will perform lip movements synchronized to the speech data. The 3D models created from a single image vary from realistic people to cartoon characters. A voice selection ...
متن کاملSpeech Driven MPEG-4 Facial Animation for Turkish
In this study, a system, that generates visual speech by synthesizing 3D face points, has been implemented. The synthesized face points drive MPEG-4 facial animation. To produce realistic and natural speech animation, a codebook based technique, which is trained with audio-visual data from a speaker, was employed. An audio-visual speech database was created using a 3D facial motion capture syst...
متن کاملMultimodal Animation System Based on the Mpeg-4 Standard
In this paper we describe experiments of real-time facial animation for generation of various virtual actors using high level-actions, compatible with MPEG-4 standard specifications. An MPEG-4 compatible synthetic face and body are integrated into an interactive real-time application allowing the user-friendly control of virtual humans' facial animation and its speech in real-time. This applica...
متن کاملA Speech Driven Face Animation System Based on Machine Learning
Lip synchronization is the key issue in speech driven face animation system. In this paper, some clustering and machine learning methods are combined together to estimate face animation parameters from audio sequences and then apply the learning results to MPEG-4 based speech driven face animation system. Based on a large recorded audio-visual database, an unsupervised cluster algorithm is prop...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 1998